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ABSTRACT 

Objectives: To determine the accuracy of the caries 
risk assessment system and performance of clinicians 
in their attempts to predict caries for children during 
routine practice. 
Design: Longitudinal study. 
Setting and participants: Data on caries risk 
assessment conducted by clinicians during routine 
practice while providing care for children in the South 
Australian School Dental Service (SA SDS) were 
collected from electronic patient records. Baseline data 
on caries experience, clinicians' ratings of caries risk 
status and child demographics were obtained for all SA 
SDS patients aged 5-15 years examined during 2002- 
2005. 

Outcome measure: Children's caries incidence rate, 
calculated using examination data after a follow-up 
period of 6-48 months from baseline, was used as the 
gold standard to compute the sensitivity (Se) and 
specificity (Sp) of clinicians' baseline ratings of caries 
risk. Multivariate binomial regression models were 
used to evaluate effects of children's baseline 
characteristics on Se and Sp. 
Results: A total of 133 clinicians rated caries risk 
status of 71 430 children during 2002-2005. The 
observed Se and Sp were 0.48 and 0.86, respectively 
(Se+Sp=1 .34). Caries experience at baseline was the 
strongest factor influencing accuracy in multivariable 
regression model. Among children with no caries 
experience at baseline, overall accuracy (Se+Sp) was 
only 1 .05, whereas it was 1 .28 among children with at 
least one tooth surfaces with caries experience at 
baseline. 

Conclusions: Clinicians' accuracy in predicting caries 
risk during routine practice was similar to levels 
reported in research settings that simulated patient care. 
Accuracy was acceptable in children who had prior 
caries experience at the baseline examination, while it 
was poor among children with no caries experience. 
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INTRODUCTION 

Despite effective population oral health pre- 
ventive programmes in many western coun- 
tries, dental caries among children remains a 



Strengths and limitations of study 



This is one among few studies measured accur- 
acy in caries risk assessment in a real life clinical 
situation. 

The study used incidence density to adjust the 
differences in number of teeth presence and the 
difference in time between baselines and follow 
up examination among children enrolled in the 
study. 

The concern about this study was children were 
treated according to their caries risk assessment 
(CRA) levels. In a hypothetical^ perfect world 
this would delete the potential of predicting the 
dependent variable because caries would have 
been prevented based on the CRA. This is 
unavoidable in any real life clinical situation 
However, this issue had been checked against 
the use of fissure sealant and the results showed 
that of the prevention provided to high risk chil 
dren might be effect very little on the accuracy of 
CRA. Finding of this study, therefore, provide evi 
dence of practice of CRA in the South Australian 
School Dental Service. 



major public health issue. 1 Certain groups of 
children develop high levels of the disease 
that compromise their quality of life and 
place a substantial burden on the healthcare 
system. 2-4 High-risk strategy is another poten- 
tial approach to address the skewed distribu- 
tion of dental caries in the population. It is 
prudent that, in order for the high-risk strat- 
egy to work, risk status of children would 
need to be identified as correctly as possible 
and appropriate preventive care would then 
be applied to them. 5 

Several studies have reported the clini- 
cians' ability to accurately identify risk for 
chronic dental diseases such as caries and 
periodontal disease. 6 7 These studies 
reported a reasonable level of accuracy, 
which was measured by combined sensitivity 
(Se) and specificity (Sp). They also reported 
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a wide variation in clinician accuracy. These studies were 
conducted under special circumstances where exami- 
ners were dentists specially trained in using risk assess- 
ment criteria. Those circumstances may provide a 'proof 
of principle' for the validity of caries risk assessment 
(CRA). However, there is little information available 
about accuracy in routine practice by clinicians who are 
not specially trained in CRA. This information is import- 
ant, as the accuracy of CRA in routine practice will have 
implications for oral health outcomes and cost of dental 
care. 

Studies have shown that clinicians' subjective estimate 
of a child's risk of developing caries was the single best 
predictor of decayed, missing or filled tooth surfaces 
(DMFS/dmfs) increment in a multivariate model adjust- 
ing for other factors. 8 This finding implied that caries 
risk could be reasonably predicted with information rou- 
tinely available to clinicians at the time of examination, 
without the need for expensive or time-consuming bio- 
logical methods that have been promoted for CRA. This 
conclusion has been supported by studies from Finland 
where dentists achieved high Sp (Sp=0.90), although with 
low Se (Se=0.44) in predicting caries risk using their sub- 
jective judgement alone. 6 In that study, the combined Se 
and Sp was 1.34 which was reasonable. Importantly, some 
individual dentists predicted caries with a high combined 
Se and Sp that approached a score of 1.60. 6 

Other studies have investigated factors that might con- 
tribute to clinicians' judgements about caries risk by 
studying child-related factors associated with clinicians' 
assessment of caries risk. A study of South Australian chil- 
dren reported that clinicians' assessment of caries risk 
was strongly associated with the caries experience of a 
child's teeth present at the time of assessment. For 
example, among 6-year-olds, mean dmfs of high-risk chil- 
dren was almost 50 times higher than that of low-risk chil- 
dren (9.91 and 0.20, respectively). Among 12-year-olds, 
mean DMFS of the high-risk children was five times 
greater than that of the low-risk children. 9 However, that 
cross-sectional study did not investigate the accuracy of 
clinicians' risk assessment, as judged against children's 
subsequent rate of caries development. 

South Australia currently has a highly developed 
public dental programme for the provision of dental 
care for school children. The service is provided mainly 
by dental therapists. Every child in South Australia is eli- 
gible for care in the School Dental Service (SDS). 
Children are invited to enrol in the South Australian 
SDS (SA SDS) when they start school at the age of 
5 years. Enrolment can occur at any time throughout 
their schooling. Children are able to access any clinic in 
the SA SDS system. Coverage of the SDS system was over 
65% of the state's primary school child population 10 
between 2002 and 2005, the period used for the current 
study. Dental care was fully subsidised for children in 
primary school (aged 5-12 years, approximately). 

In the early 1990s, the SA SDS adopted the risk assess- 
ment strategy as the approach to individual patient 



management in the SDS clinic and implemented it as a 
personalised dental care programme. 11 At each dental 
examination, the children would be classified as having 
either high, medium or low risk of developing caries. 
Clinical guidelines for classification of risk status were 
developed within each South Australian Dental Services 
health region. The broad guideline basically asked clin- 
ician to consider patient as high, medium or low risk if 
patient satisfied one or more factors on the list such as 
having past or current caries experience, active decalci- 
fied lesion and severe hypoplasia. Clinicians were also 
instructed to look for dietary habits, oral hygiene habits, 
fluoride exposure and social history factors while 
making decision on child risk level. The decision regard- 
ing risk level was left to be made based on the subjective 
estimate of the dentist or dental therapist who assessed 
and provided care for the child. Once the risk status of 
a child had been assigned, appropriate services (treat- 
ments or preventions) and recall interval would be 
determined for the individual. Preventive services such 
as fissure sealants and professionally applied fluoride are 
more routinely provided to high-risk children as com- 
pared with low-risk children. Oral health education was 
provided to all children. Recall interval could range 
from 10 to 15 months for high-risk children and 18 to 
24+ months for low-risk children. However, the accuracy 
of the CRA system in general and the performance of 
individual clinicians in their attempts to predict caries 
have not been examined. In addition, knowing an indi- 
vidual clinician's accuracy would help to further explore 
clinician factors that might influence the accuracy of 
CRA. Such an understanding would help to assess the 
effectiveness of the risk-based prevention strategy at a 
programme level and help to deliver better dental care 
to children in South Australia. Therefore, this study 
aimed to quantify the accuracy of CRA in routine prac- 
tice and initially explore the factors that are associated 
with the accuracy of CRA in the SA SDS. 

METHODS 

The sampling frame for this study was children aged 5- 
15 years examined in the SA SDS between 2002 and 
2005. In SA, since 2001, patient data have been captured 
in electronic patient records (TITANIUM) as part of 
routine clinic practice. Clinician had been trained in a 
small group. Deidentifled records were extracted with 
only identification number by SA SDS and transferred to 
the Australian Research Centre for Population Oral 
Health (ARCPOH) at the University of Adelaide. 
Informed parental consent was obtained for the clinical 
data extraction. Analysis was conducted with SAS V.9.1. 

Data collection 

The baseline and follow-up examination 

The first task during data management was to select 
from the dataset each child's first examination in the 
4-year period ('baseline' examination). Dates from that 
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baseline examination were used to select a subsequent 
follow-up examination, if one existed. The first available 
re-examination of a child that was made 6 or more 
months after his/her baseline examination was chosen 
as the follow-up examination for that child. Data from 
the baseline and the selected follow-up examination 
were used for the analysis. Children with only one exam- 
ination during the study period were excluded from the 
analysis. 

Data items 

Information recorded during each examination and 
exported from TITANIUM included: caries experience 
of each tooth surface; child's risk status at baseline 
examination as classified by the examining clinician and 
sociodemographic parameters such as child sex, resi- 
dency location, country of birth and indigenous status. 
Clinician code was also provided in the dataset. 

Individual tooth surfaces were classified as decayed, 
filled or missing because of caries. An additional code 
designated surfaces that contained fissure sealants and 
that were otherwise sound and not restored. Five sur- 
faces were coded for all teeth including molars, incisors 
and canines. For all dentitions, additional guidelines 
were used to distinguish between teeth missing due to 
caries and teeth that might have been exfoliated or were 
extracted for orthodontic reasons. 12 The SA SDS clinical 
staff (where the vast majority are dental therapists) were 
trained in assessment and recording of dental caries fol- 
lowing the guidelines developed by the ARCPOH 
researchers based on the WHO guidelines 13 and the 
National Institute of Dental Research 14 protocol. 
However, there were no additional procedures for cali- 
brating examiners. 

Computation of dmfs and DMFS indices 

Tooth surface-level data from baseline examinations 
were used to compute dmfs/DMFS. Deciduous dmfs was 
calculated for children aged 5-10 years and permanent 
DMFS was calculated for children aged 6-15 years. The 
dmfs and DMFS scores were calculated as sum of DMFS 
due to caries of the deciduous or permanent dentition. 
For each child, total number of dmfs+DMFS was 
calculated. 

Computation of caries incidence density (ID) 

Net caries increment (NCI) was computed using a De 
Paola grid. 15 The De Paola grid documented the status 
of all surfaces at the two examinations, and mapped the 
changes in status that were caries increments. It also 
identified reversals in caries status or false decrements. 
Such false negatives were used to estimate the error asso- 
ciated with apparent positive increments. This method 
assumed that the number of errors due to false incre- 
ments was equivalent to the number of errors due to 
false decrements and the resulting NCI represented the 
corrected estimate of true caries activity. In order to cal- 
culate surface-years at risk, the De Paola grid was also 



used to measure tooth surface time at risk for each 
individual. 16 

Number of new carious events during the study period (NCI) 
Total number of surface — years at risk in the study 

Caries ID for each individual at the tooth-surface level 
was computed according to the above equation. In this 
study, children were aged between 5 and 15 years. Most 
children aged between 6 and 11 have a mixed dentition. 
A large proportion of clinician's risk assessment and pre- 
dictions of caries development was for children with 
mixed dentitions in this study. Therefore, ID was calcu- 
lated as combined ID for deciduous and permanent 
dentitions. ID was calculated following the above 
formula, total number of new carious lesions including 
deciduous and permanent dentition divided by total 
number of surface-year at risk in deciduous and perman- 
ent dentition. For children who were 11 years or older at 
baseline, increment in the deciduous teeth was consid- 
ered as zero. 

Calculation of Se and Sp 

In order to achieve the aim of study in measuring the 
accuracy of CRA in routine practice and to enable com- 
parison to that reported in other studies, Se and Sp 
were used as the measures of CRA accuracy. 

ID (observed rate of caries development) was dichoto- 
mised, classifying children as having a high caries rate if 
they developed at least 1.2 new carious events per 100 
surface-years at risk. Children with a lower rate of caries 
were classified as having a low caries rate. The dichoto- 
mised rate was then used as the gold standard for calcu- 
lating Se and Sp. The cut-off of 1.2 new carious events 
per 100 surface-years at risk was selected because the 
resulting proportion of children with a high caries rate 
was equivalent to or concordant with the proportion of 
children judged by clinicians to be at high risk at 
baseline. 

Se and Sp were calculated using contingency tables 
that cross-classified children according to clinician's 
baseline risk assessment and observed rate of caries 
development (ID). Se and Sp were calculated for each 
clinician who had examined at least 20 children with 
baseline and follow-up data during study period. In 
order to calculate Se and Sp, low and medium categor- 
ies of risk assigned by clinicians at baseline were aggre- 
gated into one group. 

Variables used in the study 

Risk status at the baseline examination was used as an 
independent variable. Sociodemographic characteristics 
of children recorded routinely during the examination 
were used as additional explanatory variables. Sex, age 
in years, indigenous status and country of birth 
(Australia or elsewhere) were collected for every child. 
Fluoridation status of the area of residence was assigned 
based on level of fluoride in public water supplies. 
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Children were also classified into two groups with/ 
without caries based on their caries experience (dmfs 
+DMFS) at baseline examination. 

Analysis 

Before developing a regression model, a description of 
this child population was carried out. A number of 
multivariate regression models were generated using 
SAS PROC GENMOD. The purpose of these models was 
to estimate associations between child-level and clinician- 
level characteristics associated with each measure of 
accuracy: Se and Sp. Separate models estimated prob- 
abilities (either Se or Sp) using the binomial distribu- 
tion and an identity link. Level of significance, direction 
and magnitude of the effect of each factor were 
examined. 

In the models for Se, the probability of being predicted 
as high risk of developing caries at baseline among chil- 
dren who had developed a high caries rate was estimated. 
The intercept of this model was the estimated Se in the 
population when all child-level factors were fixed at the 
selected reference category for that factor. Reference cat- 
egories were selected to represent either the largest 
number of children from among two or more categories 
of a child-level characteristic or a conventional demo- 
graphic group. The estimates of individual factors indi- 
cated direction and magnitude of effect of those factors. 
If the estimate of a factor has a negative value, this indi- 
cated that Se or Sp was lower in the non-reference cat- 
egory than in the reference category. 

In the models of Sp, probability of being predicted as 
low risk at baseline among children who had a low rate of 
the disease during the follow-up was estimated. Similarly, 
direction and magnitude of the effect of individual 
factors were presented as the estimates of the models. 

RESULTS 

A total of 133 clinicians examined 71 430 children with 
two or more examinations within the time interval at 
least 6 months apart. The majority of clinicians practised 
as dental therapists (83%) while the remainder 17% 
were dentists. About 88.6% of clinicians were women 
and 79.4% were Australian-born. The modal age group 
was 41-50 years (41.3% of clinicians) and only 12.7% 
were aged 23-30 years. Nearly one-half of the respon- 
dents had 21-30 years of experience working in dentis- 
try. More than half of the respondents reported working 
part-time, while only 2.4% reported they were employed 
on a casual basis (data not shown). The distribution of 
children by sex and residential location was similar to 
distribution of children for the whole state of South 
Australia. Two-thirds of the children were from metro- 
politan areas. Just under half of the children had experi- 
ence of deciduous or permanent caries at baseline 
(table 1). 

Time interval between two examinations ranges from 
6 months to 4 years. Around 12% of children had 



follow-up after less than 12 months and 90% of children 
of this group were classified as medium or high risk 
(table 1). Only 2% of children had a follow-up examin- 
ation later than 4 years. These children were excluded 
from the analysis. 

Children who were classified at baseline as high risk of 
developing caries had significantly higher mean baseline 
dmfs and DMFS compared with those who were classi- 
fied as medium or low risk of developing caries (7.52 vs 
1.36 and 0.20 for deciduous dmfs; 1.30 vs 0.57 and 0.29 
for permanent DMFS; table 2). High-risk children devel- 
oped nine and two times higher caries ID for deciduous 
dentition compared with low-risk and medium-risk chil- 
dren, respectively (table 2). Similarly, for permanent 
dentition, the mean of ID was 0.99 among high-risk chil- 
dren, which is five times higher than that among 
low-risk children (ID=0.17). High-risk children devel- 
oped almost nine times higher caries ID for combined 
deciduous and permanent dentition compared with 
low-risk children (table 2). 

Se of individual clinicians ranged from 0 to 0.92 with 
the mean of 0.46 (figure 1). Over half of the clinicians 
had Se within the range of 0.40-0.60, while only 14% of 
clinicians achieved high Se of 0.7 or more (figure 1). 
Individual clinicians had a mean Sp of 0.86 with a 
minimum of 0.61 and a maximum of 1.00. About 82% 
of clinicians had Sp within the range of 0.80-1.00 
(figure 2). The level of overall accuracy for each 



Table 1 Study sample characteristics 



Variables (effective n) 



Study sample 
characteristics (%) 



Total (71 430) 

Sex (71 430) 

Boy 50.8 

Girl 49.2 

Born in Australia (62 341) 

Yes 95.7 

No 4.3 

Indigenous identity (59 954) 

Indigenous 2.1 

Non-indigenous 97.9 

Residential location (67 305) 

Adelaide (Capital city) 66.5 

Other areas 33.5 

Risk status at baseline (71 430) 

Low risk 21 

Medium risk 57.9 

High risk 21.1 

Caries status at baseline (71 430) 

DMFS+dmfs=0 53.3 

DMFS+dmfs>0 46.7 

Time interval between two examination (71 430; months) 

6-12 12.18 

12-18 44.5 

>18 43.32 

Some children had missing information on several variables. 
DMFS/dmfs, decayed, missing or filled tooth surfaces. 
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Table 2 Caries experience at baseline and caries increment during the follow-up by baseline risk 




Low-risk at baseline 
Mean (95% CI) 


Medium-risk at baseline 
Mean (95% CI) 


High-risk at baseline 
Mean (95% CI) 


Baseline caries experience 

Baseline dmfs 

Baseline DMFS 

Baseline DMFS+dmfs 
Caries rate (incidence density*) 

Deciduous dentition 

Permanent dentition 

Combined 


n on (c\ i o \r\ n oo\ 
U.^iU (U.iy TO Kj.tLtL) 

0.29 (0.27 to 0.31) 

0.49 (0.47 to 0.52) 

0.32 (0.30 to 0.34) 
0.17 (0.16 to 0.17) 
0.20 (0.19 to 0.21) 


\ .00 \ \ .66 TO \ .6\5) 
0.57 (0.56 to 0.59) 
1 .93 (1 .90 to 1 .96) 

0.84 (0.82 to 0.85) 
0.37 (0.36 to 0.37) 
0.52 (0.51 to 0.53) 


"7 CO /"7 A(\ \r\ 1 CC\ 

1 .DiL (/.4U TO /.OD) 

1 .30 (1 .25 to 1 .34) 

8.82 (8.70 to 8.95) 

2.83 (2.77 to 2.88) 
0.99 (0.97 to 1 .02) 
1.74 (1.71 to 1.77) 


Estimates were judged to be statistically significant if their 95% CIs did not overlap, 
incidence density: newly affected surfaces per 100 surface-years at risk. 
DMFS/dmfs, decayed, missing or filled tooth surfaces. 





clinician was assessed by combining Se and Sp (Se+Sp). 
The majority of clinicians had a combined Se+Sp 
ranging from 1.30 to 1.50. There were 5% of clinicians 
who had a low combined Se+Sp. There were also 5% of 
clinicians who achieved a combined Se+Sp over 1.50 
(figure 3). 

Se and Sp of CRA among SA SDS children was 0.47 
and 0.86, respectively (table 3). The combined Se and 
Sp was 1.33. More than half of the children who devel- 
oped a high rate of caries within one recall cycle were 
not classified as being high risk at baseline. 

Se and Sp were influenced by children's caries experi- 
ence at baseline. Among children without caries experi- 
ence at baseline, Se was low (se=0.07) while Sp was 
almost perfect (sp=0.98). Among children with caries 
experience at baseline, Se improved significantly com- 
pared with that among the no caries experience group 
(0.57 vs 0.07, respectively), while Sp decreased from 0.98 
among group without caries experience to 0.72 among 
the group with caries experience (table 3) . 

A number of other child-level factors were found asso- 
ciated with Se and Sp scores of CRA in multivariate 
models (table 4). The directions of association between 
Se and Sp with every variable were reversed except for 
the level of fluoride concentration in the water. 
Examining children with no caries experience reduced 
the Se by 0.48 and increased the Sp by 0.26. Children's 



age was also another factor that influenced the accuracy 
of CRA. Examining younger children increased the Se 
by 0.11 while decreasing the Sp by 0.03 (table 4). 

DISCUSSION 

In this study of caries, clinicians were moderately accurate 
in correctly identifying children who later developed a 
low rate of caries (Sp=0.86). However, they had lower 
accuracy in correctly identifying children who later devel- 
oped a high rate of caries (Se=0.47). Among children 
with caries experience at their baseline examination, 
there was greater accuracy in correctly predicting a high 
rate of caries (Se=0.57), although it came at the expense 
of reduced accuracy in correctly predicting a low rate of 
caries (Sp=0.71). However, accuracy was scarcely better 
than chance (Se+Sp=1.05) among children with no caries 
experience at their baseline examination. 

Several aspects of the study setting and the study 
methods need to be considered when interpreting the 
results. As the study was based on routine practice, chil- 
dren received dental care, including caries prevention 
such as fissure sealants, fluoride varnish and dental 
health education, according to their level of assessed risk. 
A certain proportion of the predicted disease could have 
been prevented by the interventions provided. This 
would result in an underestimation of CRA accuracy 




Sensitivity Specificity 
Figure 1 Individual clinician's sensitivity. Figure 2 Individual clinician's specificity. 
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40-| 





Total number of clinician 


133 




Minimum 


0.9 


| 30- 


Maximum 


1.62 


Mean 


1.32 




Std. Deviation 


0.12 




combined Se+Sp 

Figure 3 Individual clinician combined sensitivity+specificity 
(Se+Sp). 

(Se and Sp). In this population, high-risk children were 
significantly more likely to receive fissure sealants com- 
pared with the children who had lower risk. Therefore, 
the more intensive use of fissure sealants in high-risk chil- 
dren was expected to reduce the rate of new caries during 
the follow-up period. High-risk children who received 
fissure sealants had a lower rate of caries development 
than high-risk children who did not receive sealants. 
Similarly, low-risk children who received sealants had a 
lower rate of caries development than those low-risk chil- 
dren who did not receive sealants. This was expected to 
result in lower accuracy among children who received sea- 
lants than among children who did not receive new sea- 
lants. However, the observed overall accuracy was virtually 
identical between the two groups (data not shown) . 

A possible reason for this finding might be that the 
effect of fissure sealant on caries increment in this child 
population was small. Also, the difference in the 



underlying rate of caries increment between the high- 
risk and the low-risk groups was substantial. The prevent- 
ive effect of fissure sealants was not enough to offset the 
difference in caries rate between the two risk groups. It 
was possible to conclude that the accuracy of CRA in 
this study population was not significantly biased by the 
preventive treatment provided to the high-risk children. 

Furthermore, when assigning a child's risk status, clini- 
cians might form their judgements after considering the 
child's likely clinical status over a longer period than 
that observed in this study. This again might contribute 
to underestimation of accuracy with the methods used 
here. 

A useful risk assessment programme is one with high 
Se and Sp. However, with the inherent trade-off between 
Se and Sp, it might be impractical to achieve high Se 
and Sp simultaneously. The overall CRA accuracy over 
one recall interval of SA SDS was 1.33. This level of 
accuracy was similar to the level reported in a Finnish 
study, 6 which was conducted in a similar primary care 
environment (children aged 5-17 years assessed by den- 
tists and dental hygienists working in a healthcare 
centre). The current study, therefore, further validated a 
realistic level in 'real-life' accuracy. The components of 
clinicians' accuracy were similar in both studies, with 
Se=0.44 and Sp=0.90 in Finish study and Se=0.47 and 
Sp=0.86 in this South Australian study. 

In the North Carolina study, 8 17 the highest CRA's 
accuracy level reached 1.45 (Se=0.60 and Sp=0.85) 
among children in grades 1 and 5. Clinicians in the 
current study had lower accuracy, especially lower Se. 
However, conditions in the current study were different 
to that of the North Carolina research study, where a 
more rigid research protocol was applied. Clinicians in 



Table 3 Overall sensitivity and specificity among children without/with caries experience at baseline 


Follow-up 






Incidence density* (gold standard) 




Risk status at baseline High rate >1.2 


Low or medium rate <1.2 


Total 


Among all children 
High, n (column proportion) 6997 (0.47)t 
Low/medium n (column proportion) 7831 (0.53) 
Total, n 14 828 


8051 (0.14) 
48 551 (0.86)1: 
56 602 


15 048 
56 382 
71 430 


Sensitivity+specificity=1 .33 
Among children without caries experience at baseline 
High, n (column proportion) 186 (0.07)t 
Low/medium, n (column proportion) 2650 (0.93) 
Total, n 2836 


609 (0.02) 

29 898 (0.98)1: 

30 507 


795 

32 548 

33 343 


Sensitivity+specificity=1 .05 
Among children with caries experience at baseline 
High, n (column proportion) 6811 (0.57)t 
Low/medium, n (column proportion) 5181 (0.43) 


7442 (0.29) 
18 653 (0.71 )t 


14 253 
23 834 


Total, n 1 1 992 


26 095 


38 087 


Sensitivity+specificity=1 .28 






incidence density: newly affected surfaces per 100 surface-years at risk. 
tSensitivity. 
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Table 4 Multivariate binomial regression model for 


sensitivity and specificity by child-level factors 




Sensitivity 


Specificity 


Estimate 


p Value 


Estimate 


p Value 


Intercept 0.58 


<0.001 


0.71 


<0.001 


Child's sex 








Boy 0.02 


0.006 


0.00 


0.0119 


Girl Ref 




Ref 




Child's country of birth 








Australia -0.09 


<0.001 


0.02 


0.0013 


Overseas Ref 




Ref 




Child's residence 








Fluoridated -0.01 


0.2867 


0.00 


0.4326 


area 








Non-fluoridated Ref 




Ref 




area 








Child's baseline caries experience 






DMFS+dmfs=0 -0.48 


<0.001 


0.26 


<0.001 


DMFS+dmfs>0 Ref 




Ref 




Child's indigenous status 








Yes 0.07 


0.0042 


-0.04 


0.006 


No Ref 




Ref 




Child's age (years) 








5-7 0.11 


<0.001 


-0.03 


<0.001 


8-12 0.01 


0.2624 


0.00 


0.049 


13-15 Ref 




Ref 




DMFS/dmfs, decayed, missing or filled tooth surfaces. 



the North Carolina study were specifically trained for 
the purpose of CRA. In the current study, clinicians 
practiced CRA as a routine part of their daily clinical 
practice that involved ongoing clinical patient care, 
including examination visits, preventive and restorative 
services and recalls. Therefore, it was expected that the 
CRA process may have lower accuracy level compared 
with that observed in the North Carolina study 

Clinicians in this study varied considerably in their 
accuracy of caries risk prediction. Some clinicians pre- 
dicted caries with a high combined Se and Sp that 
approached a score over 1.50, while some clinicians had 
a much lower accuracy This finding is comparable with 
results reported in Finland by Alanen. 6 The variation 
among clinician's accuracy of CRA indicates that there 
are some clinician-related factors that might account for 
the difference in the level of accuracy 

A study evaluating predictive accuracy of CRA per- 
formed during routine clinical practice among adult 
patients also reported a level of overall accuracy that was 
similar to the level observed in this study. 18 The 
observed Se score in this current study was slightly lower 
compared with that in the other study (0.47 vs 0.57, 
respectively). However, CRA in this South Australian 
study was performed in a population including children 
with a mixture of deciduous dentition, mixed dentition 
phase and permanent dentition in contrast to the above 
study where adults with permanent dentition were 
examined. 



The difficulty in individual assessment of future caries 
risk is widely accepted. This was evident in this current 
study. However, at the group level, risk assessment is 
much stronger. The fact that children in the low-risk 
group developed significantly fewer new carious lesions 
than children in high-risk group (table 2) revealed that 
risk assessment at the group level was far more accurate. 

The stratified analysis (table 3) revealed some level of 
interaction between clinicians' ability to predict caries 
and the true risk of developing caries. Clinicians were 
more likely to assign high-risk status to children with 
caries experience at baseline, who in turn, might truly 
be at higher risk of developing new caries. Hence, the 
non-stratified analysis was a mixed effect of the afore- 
mentioned issues. The stratified analysis isolated the 
clinicians' true capacity to predict caries, and in both 
strata, the accuracy level was lower than the non- 
stratified estimates of accuracy. 

The stratified analysis, confirmed by the multivariate 
analysis, indicated the strong effect of previous caries 
experience on accuracy of CRA. This finding was 
reported in the previous assessment of CRA. It means 
that CRA in the current form may have little value among 
children who have no previous caries experience. 

There may be some criticism that the data used to 
measure the outcome variable, dental caries rate, were 
collected by uncalibrated clinicians. However, those clini- 
cians were similarly trained and used uniform clinical 
manuals to perform the examinations. In addition, the 
protocol was developed by experienced oral epidemiolo- 
gists from the University of Adelaide in collaboration 
with South Australian Dental Service clinical leaders. 
This approach was also consistent with a recent state- 
ment by Hausen et al 19 that "In large enough settings, 
data obtained from patient records could possibly be 
used as a replacement for separate surveys." Also, ana- 
lyses were based on the presence/absence of cavitated 
caries lesion (either filled or not), which is reliable. 20 

The time interval between examinations in purposively 
designed CRA studies was often set to be uniform. Caries 
increment is time dependent. Therefore, NCI was often 
the 'gold standard' of choice in those studies. This was 
not possible in this study, where the time interval 
between examinations varied considerably among chil- 
dren. The time factor was important in computation of 
caries increment. Children in the general population 
may have different time intervals between their dental 
visits that may affect the amount of disease development 
during the recalls. The children in this study were of dif- 
ferent age groups who would naturally have different 
numbers of teeth, deciduous and permanent, present in 
their mouth, and hence being at risk for having caries. 
One advanced technique that was used in this study was 
the calculation of ID. The ID calculated in this study can 
adjust for different time intervals and the number of 
teeth present in the mouth. The time and the number of 
tooth surfaces present indicate the level of risk exposure 
for a child during the study period. Variation in risk 
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exposure level was appropriately handled. For that 
reason, ID was used as the 'gold standard' in this study 
which helped to overcome that problem. 

This study provided evidence that routine CRA per- 
formance among children in the SA SDS was relatively 
accurate at the group level. However, at the individual 
level, accuracy was lower, especially among those chil- 
dren with no previous caries experience. The study find- 
ings are in accordance with the existing studies that we 
cannot predict caries very well and that there is a large 
difference between caries-free and caries-active popula- 
tions. It also suggests that this might be the time for 
researchers to minimise the search for more information 
on how to predict caries, as caries risk prediction is only 
for clinical management, and to pay more attention to 
research and providing an evidence-based approach to 
population prevention strategies according to caries-free 
and caries-active status. An explicit decision about CRA 
should be made in the future: CRA is a population oral 
health prevention strategy or CRA is a clinical monitor- 
ing strategy. 21 

To conclude, this study confirms that CRA within SDS 
is only a method to justify when to place children into 
different recall interval. 
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